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IMAGES COMBINATION PROCESSING SYSTEM, 
IMAGES COMBINATION PROCESSING METHOD, AND 
IMAGES COMBINATION PROCESSING PROGRAM 

Background of the Invention 

5 Field of the Invention 

The present invention relates to an images 
combination processing system, an images combination 
processing method, and an images combination processing 
program for executing combination processing of split 
10 images* 

The present invention also relates to an images 

v. 

combination processing system, an images combination 
processing method, and an images combination processing 
program for executing combination processing of partial 
15 images that constitutes a picked-up image. 

Description of the Related Art 

Image data of an image picked up by a digital camera 
or the like are often subjected to the compression process. 
20 One of compression processes is "JPEG system". However, 
since the compression based on the JPEG system is processed 
in unit of a sheet of image, a time required for the 
compression process is prolonged if a data size of the 
image is large. In particular, since the imaging devices 
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of the digital cameras that are put nowadays on the market 
have a large number of pixels, the data size per one 
original image is large. 

Therefore, in the solid state imaging device set 
5 forth in JP-A-2002-84493, the processes such as the YC 
conversion, the JPEG compression, etc. are applied in 
parallel to 2-channel output signals that are output from 
the solid state imaging device having left/right horizontal 
2-channel outputs. Also, as shown in FIG. 15, restart 

10 markers indicated by the numbers 1 to 8 are inserted 
separately into JPEG data 50, 51 on each channel 
respectively at the time of JPEG compression process, and 
then two JPEG files (JPEG 0, JPEG 1) into which the restart 
marker are inserted are written into a memory respectively. 

15 Then, upon generating one image file by combining 

these two JPEG files, each JPEG file is read in a time- 
series from the memory, then the reading of the JPEG file 
is switched when the restart marker is detected, and then 
the restart marker is replaced. For example, when the 

20 restart marker 1 is detected during when the JPEG 0 file is 
being read, the reading of the JPEG 1 file is started by 
switching the reading of the file, then the restart marker 
is replaced with the restart marker 2 when the restart 
marker 1 is again detected there, and then the reading of 

25 the JPEG 0 file is started. The left/right image data 
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being divided into two JPEG files are combined by repeating 
above operations, so that one image is generated. 

As a result, according to the solid state imaging 
device set forth in JP-A-2002-84493, a plurality of JPEG 
5 file images can be combined into one image. Also, since 
the JPEG compressing process is applied in parallel to the 
image data being picked up by the solid state imaging 
device, the processing speed can be enhanced. 

JP-A-2002-84493 is known as a related art. 

10 However, in the solid state imaging device set forth 

in JP-A-2002-84493, when a plurality of JPEG files are 
combined, the reading of the JPEG file is switched while 
detecting the restart marker. Therefore, the process 
becomes complicated, and as a consequence, it takes much 

15 time to execute the combining process. 

Summary of the Invention 

The object of the present invention is to provide an 
images combination processing system, an images combination 
processing method, and an images combination processing 
20 program, which enables to execute combination processing of 
split images in a short time. 

Another object of the present invention is to provide 
an images combination processing system, an images 
combination processing method, and an images combination 
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processing program, which enables to execute combination 
processing of partial images that constitutes a picked-up 
image in a short time. 

The invention provides a images combination 
5 processing system for executing combination processing of 
split images, having: split-image compressing means for 
compressing image data of each area out of a plurality of 
areas into which a picked-up image is split; restart marker 
inserting means for inserting plural types of restart 

10 markers into compressed data, which are compressed by the 
split-image compressing means, from a head of the 
compressed data in a circulatory order of the plural types, 
and inserting a special restart marker into a rearmost 
portion of the compressed data; data length counting means 

15 for counting a data length of the compressed data into 
which the restart markers and the special restart marker 
are inserted by the restart marker inserting means; 
compressed data storing means for storing the compressed 
data of each split image into which the restart markers are 

20 inserted; special restart marker detecting means for 
detecting the special restart marker from areas in the 
compressed data storing means, which are identified based 
on the data length counted by the data length counting 
means; and restart marker replacing means for reading 

25 compressed data that extend from the restart marker, which 
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is inserted into the head of the compressed data, to the 
special restart marker from the compressed data storing 
means to replace the special restart marker with a last 
restart marker contained in the restart markers, wherein 
5 the split-image compressing means, the restart marker 
inserting means, and the data length counting means execute 
each process for each split image of the picked-up image, 
and the special restart marker detecting means and the 
restart marker replacing means execute each process for all 

10 split images of the picked-up image. 

In this manner, the special restart marker is 
inserted into the rearmost portion of the compressed data 
and then the special restart marker is detected after the 
areas in the compressed data storing means, in which the 

15 compressed data are stored, are identified based on the 
data length. Therefore, the special restart marker can be 
detected effectively in a short time. As a result, the 
split image combining process can be executed in a short 
time . 

20 Furthermore, the images combination processing system 

has header attaching means for attaching a header which 
includes information indicating the data length counted by 
the data length counting means, and information indicating 
an area of the picked-up image, where the split-image of 

25 the compressed data positions, to the compressed data into 
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which the restart markers and the special restart marker 
are inserted by the restart marker inserting means; and 
reading-order deciding means for deciding a reading order 
of the compressed data by the restart marker replacing 
5 means, with reference to headers attached to the compressed 
data of each split image that are stored in the compressed 
data storing means. Therefore, the combination processing 
of the split images can be smoothly executed. 

Furthermore, the split-image compressing means 

10 executes a compression based on a JPEG system. 

The invention provides an imaging device having: 
image picking-up means for picking up an image; split-image 
compressing means for compressing image data of each area 
out of a plurality of areas into which a picked-up image is 

15 split; restart marker inserting means for inserting plural 
types of restart markers into compressed data, which are 
compressed by the split-image compressing means, from a 
head of the compressed data in a circulatory order of the 
plural types, and inserting a special restart marker into a 

20 rearmost portion of the compressed data; data length 
counting means for counting a data length of the compressed 
data into which the restart markers and the special restart 
marker are inserted by the restart marker inserting means; 
compressed data storing means for storing the compressed 

25 data of each split image into which the restart markers are 
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inserted; special restart marker detecting means for 
detecting the special restart marker from areas in the 
compressed data storing means, which are identified based 
on the data length counted by the data length counting 
means; and restart marker replacing means for reading 
compressed data that extend from the restart marker, which 
is inserted into the head of the compressed data, to the 
special restart marker from the compressed data storing 
means to replace the special restart marker with a last 
restart marker contained in the restart markers, wherein 
the split-image compressing means, the restart marker 
inserting means, and the data length counting means execute 
each process for each split image of the picked-up image, 
and the special restart marker detecting means and the 
restart marker replacing means execute each process for all 
split images of the picked-up image. 

The invention provides an images combination 
processing method of executing combination processing of 
split images, having: a split-image compressing step of 
compressing image data of each area out of a plurality of 
areas into which a picked-up image is split; a restart 
marker inserting step of inserting plural types of restart 
markers into compressed data, which are compressed by the 
split-image compressing step, from a head of the compressed 
data in a circulatory order of the plural types, and 



inserting a special restart marker into a rearmost portion 
of the compressed data; a data-length counting step of 
counting a data length of the compressed data into which 
the restart markers and the special restart marker are 
inserted by the restart marker inserting step; a compressed 
data storing step of storing the compressed data of each 
split image, into which the restart markers are inserted, 
in compressed data storing means; a special restart marker 
detecting step of detecting the special restart marker from 
areas in the compressed data storing means, which are 
identified based on the data length counted by the data- 
length counting step; and a restart marker replacing step 
of reading compressed data that extend from the restart 
marker, which is inserted into the head of the compressed 
data, to the special restart marker from the compressed 
data storing means to replace the special restart marker 
with a last restart marker contained in the restart 
markers, wherein the split-image compressing step, the 
restart marker inserting step, and the data-length counting 
step execute each process for each split image of the 
picked-up image, and the special restart marker detecting 
step and the restart marker replacing step execute each 
process for all split images of the picked-up image. 

Furthermore, the images combination processing method 
has a header attaching step of attaching a header which 
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includes information indicating the data length counted by 
the data-length counting step, and information indicating 
an area of the picked-up image, where the split-image of 
the compressed data positions, to the compressed data into 
5 which the restart markers and the special restart marker 
are inserted by the restart marker inserting step; and a 
reading-order deciding step of deciding a reading order of 
the compressed data by the restart marker replacing step, 
with reference to headers attached to the compressed data 
10 of each split image that are stored in the compressed data 
storing means . 

Furthermore, the split-image compressing step 
executes a compression based on a JPEG system. 

The invention provides an images combination 
15 processing program for executing the images combination 
processing method by a computer. 

The invention provides an images combination 
processing system for executing combination processing of 
partial images that constitutes a picked-up image, having: 
2 0 partial image compressing means for compressing image data 
of the partial images; restart marker inserting means for 
inserting plural types of restart markers into compressed 
data, which are compressed by the partial image compressing 
means, from a head of the compressed data in a circulatory 
25 order of the plural types, and inserting a special restart 
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marker into a rearmost portion of the compressed data; data 
length counting means for counting a data length of the 
compressed data into which the restart markers and the 
special restart marker are inserted by the restart marker 
5 inserting means; compressed data storing means for storing 
the compressed data of each partial image into which the 
restart markers are inserted; special restart marker 
detecting means for detecting the special restart marker 
from areas in the compressed data storing means that are 

10 identified based on the data length counted by the data 
length counting means; and restart marker replacing means 
for reading compressed data that extend from the restart 
marker, which is inserted into the head of the compressed 
data, to the special restart marker from the compressed 

15 data storing means to replace the special restart marker 
with a last restart marker contained in the restart 
markers, wherein the partial image compressing means, the 
restart marker inserting means, and the data length 
counting means execute each process for each partial image 

20 constituting the picked-up image, and the special restart 
marker detecting means and the restart marker replacing 
means execute each process for all partial images 
constituting the picked-up image. 

In this manner, the special restart marker is 

25 inserted into the rearmost portion of the compressed data, 
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and then such special restart marker is detected after 
areas of the compressed data storing means, in which the 
compressed data are stored, are identified based on the 
data length. Therefore, the special restart marker can be 
5 detected effectively in a short time. As a result, the 
combining process of a plurality of partial images 
constituting the picked-up image can be executed in a short 
time . 

Furthermore, the images combination processing system 

10 has header attaching means for attaching a header which 
includes information indicating the data length counted by 
the data length counting means, and information indicating 
an area of the picked-up image, where the partial image of 
the compressed data positions, to the compressed. data into 

15 which the restart markers and the special restart marker 
are inserted by the restart marker inserting means; and 
reading order deciding means for deciding an reading order 
of the compressed data by the restart marker replacing 
means, with reference to the header attached to the 

20 compressed data of each partial image that are stored in 
the compressed data storing means. Therefore, the 
combination processing of the partial images can be 
smoothly executed . 

Furthermore, the partial image compressing means 

25 executes a compression based on a JPEG system. 
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The invention provides an imaging device having: an 
imaging element including a plurality of imaging means 
which pick up partial images; partial image compressing 
means for compressing image data of the partial images; 
5 restart marker inserting means for inserting plural types 
of restart markers into compressed data, which are 
compressed by the partial image compressing means, from a 
head of the compressed data in a circulatory order of the 
plural types, and inserting a special restart marker into a 

10 rearmost portion of the compressed data; data length 
counting means for counting a data length of the compressed 
data into which the restart markers and the special restart 
marker are inserted by the restart marker inserting means; 
compressed data storing means for storing the compressed 

15 data of each partial image into which the restart markers 
are inserted; special restart marker detecting means for 
detecting the special restart marker from areas in the 
compressed data storing means that are identified based on 
the data length counted by the data length counting means; 

20 and restart marker replacing means for reading compressed 
data that extend from the restart marker, which is inserted 
into the head of the compressed data, to the special 
restart marker from the compressed data storing means to 
replace the special restart marker with a last restart 

25 marker contained in the restart markers, wherein the 
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partial image compressing means, the restart marker 
inserting means, and the data length counting means execute 
each process for each partial image constituting the 
picked-up image, and the special restart marker detecting 
5 means and the restart marker replacing means execute each 
process for all partial images constituting the picked-up 
image . 

The invention provides an images combination 
processing method of executing a combining processing of 

10 partial images that constitutes a picked-up image, having: 
a partial image compressing step of compressing image data 
of the partial images; a restart marker inserting step of 
inserting plural types of restart markers into compressed 
data, which are compressed by the partial image compressing 

15 step, from a head of the compressed data in a circulatory 
order of the plural types, and inserting a special restart 
marker into a rearmost portion of the compressed data; a 
data length counting step of counting a data length of the 
compressed data into which the restart markers and the 

20 special restart marker are inserted by the restart marker 
inserting step; a compressed data storing step of storing 
the compressed data of each partial image, into which the 
restart markers are inserted, in compressed data storing 
means; a special restart marker detecting step of detecting 

25 the special restart marker from areas in the compressed 
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data storing means that are identified based on the data 
length counted by the data length counting step; and a 
restart marker replacing step of reading compressed data 
that extend from the restart marker, which is inserted into 
the head of the compressed data, to the special restart 
marker from the compressed data storing step to replace the 
special restart marker with a last restart marker contained 
in the restart markers, wherein the partial image 
compressing step, the restart marker inserting step, and 
the data length counting step execute each process for each 
partial image constituting the picked-up image, and the 
special restart marker detecting step and the restart 
marker replacing step execute each process for all partial 
images constituting the picked-up image. 

Furthermore, the images combination processing method 
has a header attaching step of attaching a header which 
includes information indicating the data length counted by 
the data length counting step, and information indicating 
an area of the picked-up image, where the partial image of 
the compressed data positions, to the compressed data into 
which the restart markers and the special restart marker 
are inserted by the restart marker inserting step; and a 
reading order deciding step of deciding an reading order of 
the compressed data by the restart marker replacing step, 
with reference to the header attached to the compressed 
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data of each partial image that are stored in the 
compressed data storing step. 

Furthermore, the partial image compressing step 
executes a compression based on a JPEG system. 
5 The invention provides an images combination 

processing program for executing the images combination 
processing method by a computer. 

The invention provides an images combination 
processing system for executing combination processing of 

10 split images, having: split-image compressing portion which 
compresses image data of each area out of a plurality of 
areas into which a picked-up image is split; restart marker 
inserting portion which inserts plural types of restart 
markers into compressed data, which are compressed by the 

15 split-image compressing portion, from a head of the 
compressed data in a circulatory order of the plural types, 
and inserting a special restart marker into a rearmost 
portion of the compressed data; data length counting 
portion which counts a data length of the compressed data 

20 into which the restart markers and the special restart 
marker are inserted by the restart marker inserting 
portion; compressed data storing portion which stores the 
compressed data of each split image into which the restart 
markers are inserted; special restart marker detecting 

25 portion which detects the special restart marker from areas 
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in the compressed data storing portion, which are 
identified based on the data length counted by the data 
length counting portion; and restart marker replacing 
portion which reads compressed data that extend from the 
5 restart marker, which is inserted into the head of the 
compressed data, to the special restart marker from the 
compressed data storing portion to replace the special 
restart marker with a last restart marker contained in the 
restart markers, wherein the split-image compressing 

10 portion, the restart marker inserting portion, and the data 
length counting portion execute each process for each split 
image of the picked-up image, and the special restart 
marker detecting portion and the restart marker replacing 
portion execute each process for all split images of the 

15 picked-up image. 

Furthermore, the images combination processing system 
has: header attaching portion which attaches a header which 
includes information indicating the data length counted by 
the data length counting portion, and information 

20 indicating an area of the picked-up image, where the split- 
image of the compressed data positions, to the compressed 
data into which the restart markers and the special restart 
marker are inserted by the restart marker inserting 
portion; and reading-order deciding portion which decides a 

25 reading order of the compressed data by the restart marker 
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replacing portion, with reference to headers attached to 
the compressed data of each split image that are stored in 
the compressed data storing portion. 

Furthermore, the split-image compressing portion 
5 executes a compression based on a JPEG system. 

The invention provides an images combination 
processing system for executing combination processing of 
partial images that constitutes a picked-up image, having: 
partial image compressing portion which compresses image 

10 data of the partial images; restart marker inserting 
portion which inserts plural types of restart markers into 
compressed data, which are compressed by the partial image 
compressing portion, from a head of the compressed data in 
a circulatory order of the plural types, and inserting a 

15 special restart marker into a rearmost portion of the 
compressed data; data length counting portion which counts 
a data length of the compressed data into which the restart 
markers and the special restart marker are inserted by the 
restart marker inserting portion; compressed data storing 

20 portion which stores the compressed data of each partial 
image into which the restart markers are inserted; special 
restart marker detecting portion for detecting the special 
restart marker from areas in the compressed data storing 
portion that are identified based on the data length 

25 counted by the data length counting portion; and restart 
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marker replacing portion which reads compressed data that 
extend from the restart marker, which is inserted into the 
head of the compressed data, to the special restart marker 
from the compressed data storing portion to replace the 
special restart marker with a last restart marker contained 
in the restart markers, wherein the partial image 
compressing portion, the restart marker inserting portion, 
and the data length counting portion execute each process 
for each partial image constituting the picked-up image, 
and the special restart marker detecting portion and the 
restart marker replacing portion execute each process for 
all partial images constituting the picked-up image. 

Furthermore, the images combination processing system 
has: header attaching portion which attaches a header which 
includes information indicating the data length counted by 
the data length counting portion, and information 
indicating an area of the picked-up image, where the 
partial image of the compressed data positions, to the 
compressed data into which the restart markers and the 
special restart marker are inserted by the restart marker 
inserting portion; and reading order deciding portion which 
decides an reading order of the compressed data by the 
restart marker replacing portion, with reference to the 
header attached to the compressed data of each partial 
image that are stored in the compressed data storing 
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portion . 

Furthermore, the partial image compressing portion 
executes a compression based on a JPEG system. 

Brief Description of the Drawings 

FIG.l is a block diagram showing an imaging device of 
an embodiment according to the present invention; 

FIG. 2 is an image view of an image that is divided 
into three areas #1 to #3; 

FIG. 3 is an image view of compressed data into which 
restart markers are inserted; 

FIG. 4 is an image view of compressed data in which a 
special restart marker FFD9 is replaced with a general 
restart marker FFD7; 

FIG. 5 is a flowchart explaining an operation of the 
imaging device of the embodiment according to the present 
invention; 

FIG. 6 is a flowchart explaining the operation of the 
imaging device of the embodiment according to the present 
invention; 

FIG. 7 is a block diagram showing an imaging device of 
another embodiment according to the present invention; 

FIG. 8 is a block diagram showing an imaging device of 
an embodiment according to the present invention; 

FIG. 9 is an image view of an image that is 
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constructed by four partial images that are picked up by an 
imaging element; 

FIG, 10 is an image view of compressed data into which 
restart markers are inserted; 
5 FIG. 11 is an image view of compressed data in which a 

special restart marker FFD9 is replaced with a general 
restart marker FFD7; 

FIG. 12 is a flowchart explaining an operation carried 
out by the imaging device of the embodiment according to 
10 the present invention; 

FIG. 13 is a flowchart explaining the operation 
carried out by the imaging device of the embodiment 
according to the present invention; 

FIG. 14 is a block diagram showing an imaging device 
15 of another embodiment according to the present invention; 
and 

FIG. 15 is a memory image view of a restart marker 
replacing operation executed by the solid state imaging 
device set forth in JP-A-2002-84493 . 

20 Detailed Description of the Preferred Embodiments 

Embodiments of an images combination processing 
system and an images combination processing method 
according to the present invention will be explained in 
detail with reference to the drawings hereinafter. In the 
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following, explanation will be made with an imaging device 
such as a digital camera having CCD, a digital video as an 
example of the images combination processing system and the 
imaging means of the embodiments. In this case, a storage 
5 media such as a small memory card is installed into this 
imaging device. 

Also, in the following, the images combination 
processing system and the images combination processing 
method according to the present invention will be explained 

10 in detail. In this case, explanation of an images 
combination processing program according to the present 
invention is contained in the explanation of the images 
combination processing method given hereunder because such 
program is applied to execute the images combination 

15 processing method. 

(First Embodiment) 

FIG.l is a block diagram showing an imaging device of 
a first embodiment. As shown in FIG.l, the imaging device 
20 of the first embodiment has a CCD 11 corresponding to 
imaging means, three compression processing portions 13a to 
13c, a buffer 15 corresponding to compressed data storing 
means, a compressed data combining portion 17 corresponding 
to special restart marker detecting means, restart marker 
25 replacing means and reading-order deciding means, and a 



storage media 19. Each of the compression processing 
portions 13a to 13c includes a YC converting portion 131, a 
memory 133, and a JPEG compressing portion 135 
corresponding to split-image compressing means. The JPEG 
5 compressing portion 135 has a restart marker inserting 
portion 1351 corresponding to restart marker inserting 
means, a data length counter 1353 corresponding to data- 
length counting means, and a header attaching portion 1355 
corresponding to header attaching means. 

10 Constituent elements of the imaging device of the 

first embodiment will be explained hereunder. 

The CCD 11 is solid state imaging means for picking 
up an image, which outputs image data of a picked-up image 
in series. The compression processing portions 13a to 13c 

15 execute JPEG compression and so on for image data of each 
area into which the image picked up by the CCD 11 is split. 

Each of the compression processing portions 13a to 13 c 
reads image data of concerned area by referring to the 
vertical synchronizing signal of the image data being fed 

2 0 from the CCD 11. 

In the present embodiment, since three compression 
processing portions 13a to 13 c are provided, an image is 
divided into three areas #1 to #3, as shown in FIG. 2. The 
compression processing portion 13a execute the processing 

25 for image data of the area #1, the compression processing 
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portion 13b execute the processing for image data of the 
area #2, and the compression processing portion 13c execute 
the processing for image data of the area #3, 

Constituent elements of the compression processing 
5 portion 13 will be explained hereunder. The YC converting 
portion 131 converts RGB or CMY image data of concerned 
area into luminance component (Y) data and color component 
(C) data. The memory 133 temporarily stores image data 
that were subjected to the YC conversion. The JPEG 

10 compressing portion 135 reads image data from the memory 
133 to execute the JPEG compression. In the JPEG 
compressing, a restart marker is inserted into compressed 
data by the restart marker inserting portion 1351, a data 
length of the compressed data into which the restart marker 

15 is inserted is counted by the data length counter 1353, and 
a header is attached to each compressed data by the header 
attaching portion 1355. 

More particularly, the restart marker inserting 
portion 1351 inserts one of restart markers of eight type 

20 (FFDO to FFD7) in turn, into the compressed data. In 
particular, in the present embodiment, a special restart 
marker FFD9 is inserted into a rearmost portion of the 
compressed data. An image view of the compressed data into 
which the restart markers are inserted is shown in FIG. 3. 

25 The data length counter 1353 counts a data length of the 
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compressed data into which the restart markers are inserted 
by the restart marker inserting portion 1351. The header 
attaching portion 1355 creates a header containing the 
information which indicates the data length counted by the 
5 data length counter 1353 to attach the header to the 
compressed data. The header also contains information 
indicating to which position of the picked-up image the 
split-image of the concerned compressed data belongs as 
well as the information indicating the data length. 

10 The buffer 15 temporarily stores compressed data 

processed by each of compression processing portions 13a to 
13c. The compressed data combining portion 17 reads the 
compressed data processed by compression processing 
portions 13a to 13c from the buffer 15 to combine them into 

15 one image file. More specifically, the compressed data 
combining portion 17 firstly decides a reading order of the 
compressed data by referring to headers of respective 
compressed data. Then, the compressed data combining 
portion 17 detects a special restart marker FFD9 by 

2 0 identifying and scanning areas corresponding to the data 
length in the buffer 15 based on the information contained 
in the headers of the compressed data and indicating a data 
length, in the decided order. Next, the compressed data 
combining portion 17 reads the compressed data extending 

25 from the head restart marker FFDO to the special restart 



marker FFD9 in the split image from the buffer 15, and then 
replaces the special restart marker FFD9 with a normal 
restart marker FFD 7, as shown in FIG. 4. In this case, the 
restart marker FFD9 of the compressed data that is lastly 
5 read may not be replaced. 

In this manner, if operations of detecting the 
special restart marker FFD9 by scanning the specified areas 
in the buffer 15 based on the information indicating the 
data length in the decided order, then reading the 

10 compressed data having the restart markers FFDO to FFD9 
from the buffer 15, and replacing the special restart 
marker FFD 9 with the restart marker FFD7 are carried out, 
all compressed data are finally combined to produce one 
image file. A header of the combined image file is created 

15 based on the headers attached by the header attaching 
portion 1355 of the compression processing portion 13 and 
is attached to the image file. The compressed data 
combining portion 17 includes a memory (not shown) for 
storing the data generated in the course of the 

20 combination. 

The storage media 19 is a recording media for storing 
the image file that is combined by the compressed data 
combining portion 17 in this manner. When the image file 
stored in the storage media 19 is to be displayed on a 

25 display portion (not shown) , such image file is read from 

25 



the storage media 19 and is expanded by a JPEG expanding 
portion (not shown) and displayed. 

Next, an operation of the imaging device (the images 
combination processing method) of the first embodiment will 
5 be explained briefly with reference to FIG, 5 and FIG* 6 
hereunder. FIG. 5 and FIG. 6 are flowcharts explaining an 
operation of the imaging device of the first embodiment. 
First, in step S101, the CCD 11 picks up the image. Then, 
in step S103, each of the compression processing portions 

10 13a to 13c loads the image data picked up by the CCD 11 
into each split area. Steps S105 to S115 explained 
hereunder are steps executed in parallel by respective 
compression processing portions 13a to 13c. In step S105, 
the YC converting portion 131 executes the YC conversion of 

15 the read image data. Then, in step S107, the JPEG 
compressing portion 135 executes the JPEG compression for 
the image data that was subjected to the YC conversion. 

Then, in step S109, the restart marker inserting 
portion 1351 inserts the restart markers into the 

20 compressed data. Then, in step Sill, the data length 
counter 1353 counts a data length of the compressed data 
into which the restart markers are inserted. Then, in step 
S113, the header attaching portion 1355 creates a header 
including the information indicating the data length being 

25 counted in step Sill, and then attaches the header to the 
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compressed data. Then, in step S115, the compressed data 
being processed by the compression processing portion 13 
are written into the buffer 15. 

Then, in step S117, an order of reading compressed 
data from the buffer 15 is decided by referring to the 
headers of respective compressed data. Then, in step S119, 
the special restart marker FFD9 is detected by scanning the 
areas in the buffer 15 corresponding to a data length of 
the compressed data as the object to be read, in the order 
decided in step S117. Then, in step S121, the compressed 
data having the head restart marker FFDO to the special 
restart marker FFD9 are read from the buffer 15. Then, in 
step S123, the special restart marker FFD9 is replaced with 
the normal restart marker FFD7 . 

Then, in step S125, it is decided whether or not all 
the compressed data necessary for the combination have been 
read. If all the compressed data have been read (if YES), 
the process goes to step S127. In contrast, unless all the 
compressed data have been read (if NO), the process goes 
back to step S119. Then, in step S127, the combined image 
file is stored in the storage media 19, and then a series 
of processes are ended. 

As explained as above, in the imaging device 
containing the images combination processing system and the 
images combination processing method of the first 
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embodiment, the special restart marker FFD9 which indicates 
the rearmost portion of the compressed data is prepared as 
one of the restart markers that are inserted into the 
compressed data, and then such special restart marker FFD9 
5 is detected after the scanned areas in the buffer 15 are 
identified on the basis of the information indicating the 
data length. In this manner, since the scanned areas in 
the buffer 15 are restricted into the particular areas, the 
special restart marker FFD9 can be effectively detected in 

10 a short time. As a result, the image combining process can 
be executed in a short time. Also, since the compressing 
process can be executed in parallel after the image data 
are spited and also the combining process thereof can be 
executed in a short time, the image data can be written 

15 into the storage media 19 in a short time even though a 
data size per one original image is large. In the present 
embodiment, although the data length is recited in the 
header, the data length counter information may be 
transmitted directly to the compressed data combining 

20 portion 17. 

In the present embodiment, although the memory 133 
for storing temporarily the image data, which was subjected 
to the YC conversion, is provided to respective compression 
processing portions 13a to 13c, a single memory 23 may be 

25 provided in common to respective compression processing 
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portions 21a to 21c as shown in FIG. 7. Also, in FIG.l, the 
buffer 15 may be used commonly to the memory 133, 

(Second Embodiment) 
5 FIG. 8 is a block diagram showing an imaging device of 

a second embodiment. As shown in FIG. 8, the imaging device 
of the second embodiment has an imaging element 31, four 
compression processing portions 33a to 33d, a buffer 15 
corresponding to compressed data storing means, a 

10 compressed data combining portion 17 corresponding to 
special restart marker detecting means, restart marker 
replacing means and reading order deciding means, and a 
storage media 19. Each of the compression processing 
portions 33a to 33d is includes a YC converting portion 

15 331, a memory 133, and a JPEG compressing portion 135 
corresponding to partial image compressing means. The JPEG 
compressing portion 135 has a restart marker inserting 
portion 1351 corresponding to restart marker inserting 
means, a data-length counter 1353 corresponding to data 

20 length counting means, and a header attaching portion 1355 
corresponding to header attaching means. 

Next, respective constituent elements that the 
imaging device of the present embodiment includes will be 
explained hereunder. 

25 First, the imaging element 31 is a solid state 
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imaging element for picking up an image, which is 
constructed by four CCDs 31a to 31d corresponding to 
imaging means. As shown in FIG. 9, a image is obtained by 
combining partial images #11 to #14 that are respectively 
5 picked up by CCDs 31a to 31d. The compression processing 
portions 33a to 33d execute JPEG compression and so on for 
image data of the partial images that are picked up by 
respective CCDs 31a to 31d of the imaging element 31. In 
the present embodiment, the compression processing portion 

10 33a executes the JPEG compression and so on for the image 
data of the partial image picked up by the CCD 31a. 
Similarly, the compression processing portion 33b executes 
the JPEG compression and so on for the image data of the 
partial image picked up by the CCD 31b, the compression 

15 processing portion 33c executes the JPEG compression and so 
on for the image data of the partial image picked up by the 
CCD 31c, and the compression processing portion 33d 
executes the JPEG compression and so on for the image data 
of the partial image picked up by the CCD 31d. 

20 Constituent elements of the compression processing 

portion 33 will be explained hereunder. The YC converting 
portion 331 converts RGB or CMY image data of concerned CCD 
31 into luminance component (Y) data and color component 
(C) data. The memory 133 temporarily stores image data 

2 5 that were subjected to the YC conversion. The JPEG 
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compressing portion 135 reads image data from the memory 
133 to execute the JPEG compression. In the JPEG 
compressing, a restart marker is inserted into compressed 
data by the restart marker inserting portion 1351, a data 
length of the compressed data into which the restart marker 
is inserted is counted by the data length counter 1353, and 
a header is attached to each compressed data by the header 
attaching portion 1355. 

More particularly, the restart marker inserting 
portion 1351 inserts one of restart markers of eight type 
(FFDO to FFD7) in turn, into the compressed data. In 
particular, in the present embodiment, a special restart 
marker FFD9 is inserted into a rearmost portion of the 
compressed data. An image view of the compressed data into 
which the restart markers are inserted is shown in FIG. 10. 
The data length counter 1353 counts a data length of the 
compressed data into which the restart markers are inserted 
by the restart marker inserting portion 1351. The header 
attaching portion 1355 creates a header containing the 
information which indicates the data length counted by the 
data length counter 1353 to attach the header to the 
compressed data. The header also contains information 
indicating to which position of the picked-up image the 
split-image of the concerned compressed data belongs as 
well as the information indicating the data length. 
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The buffer 15 temporarily stores compressed data 
processed by each of compression processing portions 33a to 
33d. The compressed data combining portion 17 reads the 
compressed data processed by compression processing 
5 portions 33a to 33d from the buffer 15 to combine them into 
one image file. More specifically, the compressed data 
combining portion 17 firstly decides a reading order of the 
compressed data by referring to headers of respective 
compressed data. Then, the compressed data combining 

10 portion 17 detects a special restart marker FFD9 by 
identifying and scanning areas corresponding to the data 
length in the buffer 15 based on the information contained 
in the headers of the compressed data and indicating a data 
length, in the decided order. Next, the compressed data 

15 combining portion 17 reads the compressed data extending 
from the head restart marker FFDO to the special restart 
marker FFD9 in the split image from the buffer 15, and then 
replaces the special restart marker FFD9 with a normal 
restart marker FFD 7, as shown in FIG. 11. 

20 In this manner, if operations of detecting the 

special restart marker FFD 9 by scanning the specified areas 
in the buffer 15 based on the information indicating the 
data length in the decided order, then reading the 
compressed data having the restart markers FFDO to FFD 9 

25 from the buffer 15, and replacing the special restart 



marker FFD9 with the restart marker FFD7 are carried out, 
all compressed data are finally combined to produce one 
image file. A header of the combined image file is created 
based on the headers attached by the header attaching 
portion 1355 of the compression processing portion 33 and 
is attached to the image file. The compressed data 
combining portion 17 includes a memory (not shown) for 
storing the data generated in the course of the 
combination . 

The storage media 19 is a recording media for storing 
the image file that is combined by the compressed data 
combining portion 17 in this manner. When the image file 
stored in the storage media 19 is to be displayed on a 
display portion (not shown) , such image file is read from 
the storage media 19 and is expanded by a JPEG expanding 
portion (not shown) and displayed. 

Next, an operation of the imaging device (the images 
combination processing method) of the first embodiment will 
be explained briefly with reference to FIG. 12 and FIG. 13 
hereunder. FIG. 12 and FIG. 13 are flowcharts explaining an 
operation of the imaging device of the first embodiment. 
First, in step S201, the imaging element 31 picks up the 
image. Then, in step S103, each of the compression 
processing portions 33a to 33d loads the image data from 
corresponding CCDs 31a to 31d of the imaging element 31. 
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Steps S105 to S115 explained hereunder are steps executed 
in parallel by respective compression processing portions 
33a to 33d. In step S105, the YC converting portion 331 
executes the YC conversion of the read image data. Then, 
in step S107, the JPEG compressing portion 135 executes the 
JPEG compression for the image data that was subjected to 
the YC conversion. 

Then, in step S109, the restart marker inserting 
portion 1351 inserts the restart markers into the 
compressed data. Then, in step Sill, the data length 
counter 1353 counts a data length of the compressed data 
into which the restart markers are inserted. Then, in step 
S113, the header attaching portion 1355 creates a header 
including the information indicating the data length being 
counted in step Sill, and then attaches the header to the 
compressed data. Then, in step S115, the compressed data 
being processed by the compression processing portion 33 
are written into the buffer 15. 

Then, in step S117, an order of reading compressed 
data from the buffer 15 is decided by referring to the 
headers of respective compressed data. Then, in step S119, 
the special restart marker FFD9 is detected by scanning the 
areas in the buffer 15 corresponding to a data length of 
the compressed data as the object to be read, in the order 
decided in step S117. Then, in step S121, the compressed 
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data having the head restart marker FFDO to the special 
restart marker FFD9 are read from the buffer 15. Then, in 
step S123, the special restart marker FFD9 is replaced with 
the normal restart marker FFD7 . 
5 Then, in step S125, it is decided whether or not all 

the compressed data necessary for the combination have been 
read. If all the compressed data have been read (if YES) , 
the process goes to step S127. In contrast, unless all the 
compressed data have been read (if NO), the process goes 

10 back to step S119. Then, in step S127, the combined image 
file is stored in the storage media 19, and then a series 
of processes are ended. 

As described above, in imaging device containing the 
images combination processing system, and the images 

15 combination processing method of the second embodiment, the 
special restart marker FFD9 which indicates the rearmost 
portion of the compressed data is prepared as one of the 
restart markers that are inserted into the compressed data, 
and then such special restart marker FFD9 is detected after 

20 the scanned areas in the buffer 15 are identified on the 
basis of the information indicating the data length. In 
this manner, since the scanned areas in the buffer 15 are 
restricted into the particular areas, the special restart 
marker FFD9 can be effectively detected in a short time. 

25 As a result, the combining process of the partial images 
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picked up by the imaging element 31 consisting of a 
plurality of CCDs 31a to 31d can be executed in a short 
time. Also, since the image data picked up by CCDs 31a to 
31d are subjected to the compression process in parallel 
and also the combining process thereof can be executed in a 
short time, the image data can be written into the storage 
media 19 in a short time even though a data size per one 
original image is large. 

In the present embodiment, although the memory 133 
for storing temporarily the image data, which was subjected 
to the YC conversion, is provided to respective compression 
processing portions 33a to 33d, a single memory 43 may be 
provided in common to respective compression processing 
portions 41a to 41d as shown in FIG. 14. 
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